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(54) 

(57\ A "technique. speeSffcaly apparatus and an 
accompanyine method, lor accurately thresholdinp an 
imaoe based on local image properties, speofcaly lun«. 
nar«e variations, and particularly such a technique that 
uses multi-windo-ving lor providing enhanced immunrty 
to image noise and lessened boundary artitacts. Speort- 
ically a locafced imensity gradient. Gfi j). is determin^ 
tor a pre^Jelined window (300) centered about ea(*i 
imaoe DweKlj). Localized n^nimum and maximum pixel 
interisity measures, and L,„,. respective^ are also 
determinedfor another, though larger, window (330) cen- 
tered aboul pixel(i.fl. Alsa a kscafeed area gradiert 
measure. GS(i j). te determined as a sum ^ "^^^ 
intensity gradients lor a matra ol pixel posrtions (370) 
centered about pixel position fi j). Each image pixel(i.O s 
then classHied as being an object pixel. i.e.. WaeK or a 
background pixel, i.e. whHe. based upon Hs area gradi- 
ert. 6S(ij). and assodaled L„*, and L^x measures. 
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Description 

TPrMNir AL FIF T ^ INVENTION 

The inven^on relates to a techn'que. specHically apparatus and an accompanying method, lor accurately thresh^ 
owing an image based on local image properties. specHically luminance variations, and particularly one that uses nuM- 
windowing for providing enhanced immunily to image noise and lessened boundary artilacts. 

pAf -^kf^ROUND ART 

With digital irrege processing and digital communication becoming increasingly prevalent today, increasing amounts 
o1 printed or other textual documents are being scanned for subsequent computerized processing of one form or another 
and/or digital transmission. This processing may involve, for example, optical character recognition, for convertng printed 
characters, whether machine printed or handwritten, from scanned bit-mapped form into an appropriate charac ter s^ , 
such as ASCII, the latter being more suitable for use with word processing and similar cornputerized document-process* 

'"^ ^^nning a gray-scale document typically yields a muW-bK. typic&lly elghl-bH, value for each pixel in the scanned 
document The value represents the luminance, in terms of a 256-level gray scale, of a pixel at e corresponding point 
in the document These pixels are generated, depending upon the resolution of the scanner, frequently at resolutions 
of 200 400 pixels/inch (approximately 80-160 pi>els/cm), though wHh highly detailed images at upwards of 1200 or more 
pi3(els/inch (approximately 470 pixels/cm). Consequently, a scanned 8 1/2 by 11 inch (approximately 22 by 28 cm) irnage 
wiy contain a considerable amount of gray-scale data. Inasmuch scanned text generally presents a writleri or printed 
characters of some sort against a contrasting colored background, typically white or tilack pririt against a white or light 
colored t«ckground, or vice versa, the exact luminance value at any one pixel in the text is not as important as whether 
that fxxel is either part of a character or the background. Therefore, scanned textual images, or scanned tertual portions 




foreground liPi»*«-»^— — — — ^ • i»» #w 

dtstinguish the different types of scanned inrjages, a gray-level image Is defined as one having multi-bit (hence mult- 
value) pixels whereas a binary (or bi-level) image is formed of single-bK pxels. Furthermore, since binary images gen-^ 
erate considerably less data for a given textual image, such as. e.g.. one-eighth, as much as for an eight-bit gray-scale 
reridering of the same image, binary images are more efficient over corresponding gray-scale images and thus preferred 
for storage and communication of textual images. Binary images are also preferred because of their easy compressibHily 
using standard conpression techniques, e.g., CCITT Groups 3 or 4.cbmpre^ion standards. 

Gray-scale images a re converted to binary images through a so-called thresholding process. In essence, each nrurt- 
bit Dixel value in a gray-scale scanned image Is compared to a pre-defined threshold value, which may be fixed, variable 
or e/en adaptively variable, to yield a single corresponding output bit. If the multi-bit pixel value equals or exceeds the 
threshold value for that particular pixel, the resultant single-bH output pixel is set to a "one*; otherwise H the threshold is 
greater than the multi-bit pixel, then the resultant single-bit output pixel remains ai ^zm\ In this manner, thresholding 
extracts those pixels, such as those which form characters, or other desired objects, from the background in a seamed 
oray-scale Image, wrth the pixels that form each character, or object, being one value, typically that for black, and the 
pixels for the bad^ground all being another value, typicafly that for white. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the inwge as simply an -objecf. 

Ideally the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
scanned irnage and maps those pixels to a common single-bit value, such as, e.g., "one' for black. In practice, noise, 
background shading, lighting non-unrformities in a scanning process and other such phenomena, preclude the use of a 
single fixed threshold for an entire image. In that regard, H the threshold is too low. the resuhing iiroge may contain an 
excessive amount of noise in certain, rf not all regions: or, H too high, insufficient image detail, agairi in certain, if not aO. 
regions - thereby complicating the subsequent processing of this image. Given this, the art recognizes that a preferred 
amroach would be to seled a different threshold value that is appropriate to each and every pixel in the scanned image. 
Iridoing so the proper threshold value is determined based upon local properties of the image, i-e., certain image 
characteristics that occur in a localized image region for that pixel. Hence, the threshold wouW vary across the image, 
possibly even adapt to changing localized Image condHions. 

In general, a common methodology for variable thresholding relies on measuring localized image characteristics, 
such as local intensity contrast (or gradient), local averaged intensity and/or local variance. \r\ a local window centered 
atK>ut a pixel of interest arxJ then using these measures to classify image pixels into either object pixels, blad^ or back- 
ground pixels, white. Here, too, reality diverges from the ideal inasmuch this methodology is complicated, and often 
frustrated by a need to extract various objects in a wide range of documents but with minimal user intervention, such 
as for purfx)ses of inrtiafizalion and object identification, and while still yielding a clean background in the thresholded 
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..K, ,KocP objects may include, e.9.. dim. broken objects: and otjeds that preserta relat««ly to« contrast, 
image. In realrty. oTav^cl^JouS- and ora^ objects ent>edded in a black background, 

such as white objects m a gray '^^S thresholding to provide adequate pferlbrmance with actual 

Nevertheless, given the oven«^hT,.ng "^^f^J^^^fJ^^ that attempt to provide saHstedory 

images, the art has persisted by '^^^'^''^^^'^^^^'J^^^^^SSlZ, In praS tend to limit their utility, 
periorn^nce. However, all these approaches are tauflhl in M. Kamel et 

'"^ various approaches based up^^^^ 

al.. -Extraction of Binary Cha;acler^.apN« jTli^H^e a logical leveT approach is based on comparing a 
.^^ .PrnrPssinQ . vol. 55. Na 3. May 1993. P^^^'^^r^^ ^^^^ 1cn»local averages in neighborhoods 
^;^fi;;;;^r^enpixel or rts J^egmytvelofthegivenj^^lssunicientlybelo^ 
centered about lour p«els orthogonally ^""""-^"^ "^^9';!^^^ ^so-called "mask^ased Subtraction-. reKes. 

all tour local averages, thence p-«" ^^^^^^c^^ Rst. most of 

on considering every pixel in an image as a f""^ « lunctionino to remove -partide* noise. The 

^background pixels are detected 

tilter te appHed to lou. P«^il«'"^"J.:^^^i!°^"5^X^^^^^ S^racter^graphics pixels which are black arKl 

ol 0. n/4. n/2 and 3n/4. The •«"«'"8 SeS iniage is nxKJf ied by detectmg additional back- 

background pixels which are "^^^'J^^'^^^^^^^^J^Z^podue character/graphics pixel, the gray level 
grouilpixels^ngapr^^^^^^^^ 

ol its background image is ^r^Z!^^^\tr^t^ image trom the original scanned image wilh tesuHing 

ics image obtained ^.^^^^^ '^^^'^^^^ image. Though the global threshold 

diflerences then being globally thresholded to y^f^A^'^^^gj Jj,^ 

value itseH is fixed, basing the resuMon » di«erence "^^^^"[^J^ ^ to be somewhat immune 
'-'^"^^ta^t^Slar^^^^^ 

l^r^^ dim ancVor brok^^^in a «v«t^^^^ ^ ^ ^ ^'jl^^ 

Another approach, as descnoeo in ° «r.es on IracWno a background value in an image, with a threshold 

value being a sum of a *^««=*'"*^'*^;°"7J^'^^^ 

occurs in the image, such as '^^^"^^ Jn^eS^SSholded pixel value has a reduced noise contem. 

modiV the threshold value such that ostensibly "f*"^ int'Uity transHtons due to abrupt char^ges 

^rr^^isfntSttnt?^^^^^^^ 

Here, adaptive threshc^ing -^j^^J.^^ ^ Ji::,;^^?,^^^^^^ Wo«set pCentia. is used In conjun^ 
; basis as a function of whrte.peak and P^!^^ , ^ pixel-by-pixel. The peak and valley poten- 

with nearest neighbor P'^-^^^^^f "Sl^r^ ^ge that Jiiel with predetermined minimum 

™k"a:? — ^^^^^^^ techn-.,ue a^ appears to ex«bl, dHfi^es m 

extracting low conirasi "^^^^^^'^^'^^''^j^ specHtoally apparatus and an accompanying method, tor accu- 
, Therefore, a need exists in the art for a .^_!f^'^^;J5^*^ ysjng a threshold that varies based on local 

,3.e,ya«f^a«ytjjj»^^9^^^^^ 

Sas^SSlTac^^dS^ low contrast objects, than do conventional .triable ,hreshold«^ technK^es. 
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Pf^o, 1RF OF THEJIiN^ENIiQN 

r4«i-irionrioR ill ihe all thTOUOh our inverilive muHi-windoftr 

we have substarrttelly and advantageously overcome the deficiencies in the an tnroug 

thresholding technique. irrtensitv Gradient GO j). is determined for each pixelfi J) in an incoming 

specifically, through our invention, « '^^'^f^''^^^/^.^^^^^ J)^ iHuslratively 3-by^. of pixels centered 
scanned gray-scale bH-mapped image. Th.s ^'^^^^^^^^^^^^ levels are detected lor an N*y-N pixel wind«v 
aboul pixeld j). Next, minirnum inters y, i;;™"" "^^.^tS ^eT^- GSfi j) being a sun of individual intensity 
centered o^er the image about P'^«'( J>: •"^J,^' ^,'™^/;^^,,y n-z-by-n-Z pixels, centered about position fi j). 
gradients, is ascertained l"'"trob^^^^^ bad^brourS pixel, i.e.. white, primarily based 

lach p.e.(i.D f 3^2'^^^^^^^^ and ll, values. T>^e three Para-te« are 

upon its area gradient. G5(i j;. T'" •^^1?^. ' ^jhthat oixel beino centered in various windows, one tor determinirH3 
rerminedfor - Jand eve^J.P;-J^^^^^^ U, and values. Once the gradient 

SS^S?I^tl?def?min^^ 
gradient GS(i j). 
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Usino these local measures, each image pi)cel(i j) is f irst classified as being near an edge or not. In that regard, each 
^•.voi an edoe is SO classified H the local measures therefor, specifically its associated area gradient, exceeds a 

0 irf^L^SiSold value. Olhenvise. that pixel is viewed as falling wHhin a locally flat field. i.e.. of relatively constant 
TjT^^ ^oecHicallv edge pixels are classified by comparing their intensity values against average intensity values 

tor il2?N.ijy-N pixel window^ therefor; in contrast, pixels in flat fields are classified by comparing their intensity against 
a pre-determined intensity value. . ^ ^ ^ «, 

In r«rtieular an image pixel(i j) located in a vicinHy of an edge in the image is detected whenever the area gradiert, 
rs« S^o?ThS fe WgK par^cularly being larger than a predefined gradient threshold. GT. Once such a p«e! J6 
ea^ a darKer Se of the edge is found. This latter pixel being in the center of a local N*y-N. e.9.. 7^^- 

7 iSd w^ow is classified as an object pixel. i.e.. Wad^ whenever Hs intensity. W is smaller than an average ol^its 
sSatedTl and Uex values. Alternatively. H the intensity of this latler pixel. L«. exceeds the average intensity value 
Li nndl!!!" then this particular pixel is classHied as being background. i.e.. wWte. 

^^he^e thTarea gradient. GS(i j). for pixelfij) is less than the gradient threshold, such as where ttte N^N window 
oiMoc atenn an image reoion of relatively constant gray-scale. pixdOj) is classHied by sinple thresholding, i.e.. thresh- 
^« »^^n?av^S«l2 against a constant predefined threshold value. IT. Here. H the grayscale value ol pixeKlj) is 
iSrfhan threshold value IT. this pixel is dassrfied as an object pixel. i.e.. blad^ othenwise. Itiis pixel is designated 

^^iJiHiS^^Qe'Ses end b^domg so further increase thresholding accuracy, the intensity values of those pixels 
«<«r an edoe are modHied. For the preferred en*odiment. black pixels are Illustratively represented by a value of zeio 
«H bv a value of Specificatly. for those pixels located on a darker side ol an edge and having an intensity 

t^.r!^t7xcleis the threshold value. IT. the intensity ol each of these pixels is reduced to a value slightly below 
T^t^ n e Q to a value IT-. In contrast the intensity values for those pixels, located on a brighter side of an edge 
VC^no an SUsity value less than threshold value IT. are increased to an intensity value slightly greater than thresh- 
old v™ue IT. e.g.. to value IT*. A high quaWy binary image can then be produced by merely thresholding the resiWng 
nrau cnale imaoe Boainst pre-defined threshold value IT. 

^Irtao«>usly through the use ol area (summed intensHy) gradients, the present invention signHicantJy reduces 
Koih t«,dlorc^nd ntfee and boundary artHact generation while accurately extracting objects in a thresholded image. The 
nwdifiedgray-scale image, when subsequently thresholded using a fixed threshold value IT greatly enhances detection 

01 low contrast objects and thus readily produces a high quality binary image 

p piFP mrfjCMP T'^^ THE DRAWItMGS 

The teachings of the present invention may be readily understood by considering the following detailed desoiption 
in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a high-le>/el block diagram of document imaging system 5 that en^odies the teachings of our present 
invention: 

FIG. 2 depicts the correct alignment ol the drawing sheets for FIGs. 2A and 2B: 

FKaS 2A and 2B collectively depict a high-level flowchart ol our inventive multi-windowing thresholding method; 

FIG 3A depicts a 3*y3 matrix of pixel location definitions which we use in determining, through a "Sobel" gradient 
operator, gradient strength for current pixelfij); 

FIG. 3B depicts a graphical representation of an N-by-N neighborhood of pixels centered about a cunent pixelfij) 
in an image intensity record; 

FIG. 3C depicts a graphical representation of an (N-2)-by-(N-2) neighborhood ol pixels centered about pixel petition 
(I j) in an image intensity gradient r ecord; 

FIG 4 graphically depicts intensity profile 400 of an inustrative scan line of an original gray-scale image, such as 
that illustratively on document 10 shown in FIG. 1 ; 

FIG 5 graphically depicts a modified intensity profile which results after thresholding intensity profile 400 shown in 
fig! 4 according to the teachings of our present invention: 

FIG 6 depicts a block diagram of a preferred emlxxJiment of our present invenfon; 
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FKx 7 depicts a block diagram of Sum ol Gradients Circuit 620 which lorms part of drcuH 600 ^rmm In FIG. 6; and 

FIG. 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also lorms part of circuH 600 
shown in FIG. 6. 

To facilitate understanding, identical reference numerals have been used, where possible, to denote identical ele- 
ments that are common to various figures. 

.«op pg OF CARq vtf^ ^ rr THg invention 

After readina the lollowing description, those skilled in the art will quickly realize that our invention is applicable lor 
use ^nearly aS document imaging system for accurately thresholding scanned documentary images cwitamingline 
art toth regardless of what that line art contains and the media upon which the image origuially appears. For example, 
the lS?e art SuW be graphs, maps, characters and/or line (skeletal) drawings. Nevertheless lor thepurpose of «mpllfyu^ 

lSf«i^r*««s^«^ will discuss our invention in the context of use in thresholdinB scanned character data, such 
as textual letters and nurrOers. which we wiB collectivdy refer to hereinafter as "obiects- ■ ^ 

iTpurposes of illustration and discussion, we define black and while gray-*cale pixels 
^llv^h^eof -0" and "SSS". respectively. For consistency, we also define output binary pixels with blad« beng "0 ai^ 

Clearly, our inventivemethod will function just as well wHh^^ 
;^uS that^^fire p«el intensHies. as would be readily apparent to those skilled in the art. reversed from those 

sho^Miand d«cra»d ^ document imaging system 5 that embodies the teachings of our present 

inJSn^^ system 5 is for med of gray-scale scanner 20. digital image processor 30 and Vimpte" *|reshold.r« 
40. ie^on' documem 10 conlaLg various objects of interest .s scanned by ^nner aOJto Produce m^- 
^^?«l Iv eioht-bit bH-mapped grayscale image data. L Thfe data is routed, va leads 25. to a data input of digte^ 
fr^SrSriesSJ^Tta^ in tiJ^nS to the extent relevant here, thresholds the scann^ irnage data and generates bolh 
L^^S^oraTscale ii^ge on leads 37 and an output binary image on leads 33. The modified gray-scale image, as 
Sr^toS^in oreater detail below, has its edges enhanced by processor 30 to subsequently Increase threshoWir^ aocu- 
o^5?3^«ro?ay scale inUge dataipearing on leads 37 is routed to an input of thresholding circuH 40 whidv 
':S^ts^J^t^^n ^9e pixel in thTmodHied Image data against a pre<.efnedf«ed threshold value ther^ 
^^r^^^Sled -simple- thresholding. The resulting thresholded. I.e.. binary, image produced by circuit 40 is applied. 
Sa"^d?4T?s So^^ouliut^i^ i!«9e. DigHal iLge processor 30 performs ttuesholding in accordance with our 
«e«rrttn>Sntion. To handle high data throughputs required for processing Ut-mapped wnages pro^ssor 30 » prefc^- 
S!!JIbriSed from dedicated hardware drcuHry. induding our inventive drcuit 600 shown in Fia 6 and discussed m 
Alternatively, this processor can be inplemented through one or more general purpose rniaoprocessors. 
SS^ asSSted memory and supporting drcuitry and suitably programmed to implement our preserit .rwention in soft- 
;;^e!^bSJ^t the micropr«essor(s) could execute instructions sufffcienHy fast to produce the requisrte data 

^''""fiSi'level flowchart of our inventive multi-windowing thresholding method 200 is collectively depicted in FIGs. 2A 
=nd 2B tor which the correct alignment ot the drawing sheets tor these f igures is shown in FKi 2. During the course of 
d^sina method 200. reference vaII also be made to FIGs. 3A-3C where appropriate. 

^e Sd 200 is performed for each and every gray-scale pixel m an incoming Image, thereby iteratng through the 
imaQ?s^ ^.e manner through which eadi gray-scale image pixel is processed R KJentical aaoss d^^^suc*. p»els. we 
^merdySscuss this routine in the context of processing generalized pixelfij). where . and , are posrtn^e integers and 
Hrfin^ rixel horizontal and vertical indices within the incoming gray-scale image. In addrton to gray-scale image data, 
i uLer sJw-ieTvalues of two input parameters. specHically fixed thresholds IT and GT. These thresholds are adjusted. 
L di^rSf below, ether to provide satisfactory thresholding across a muHHude of d-Hering images with varying d«r- 
«rte^i« such as contrast and illumination, or can be adjusted to provide optimum threshold^^ for any one type of 
f^ofaSor scanning condHfon. In any evert, as a result of pedorming method 200 on all sudi gray-scale image pocels. 
LTesh^ed binary or modried gray-scale image will be generated, with each pixel in the resu^^^^ 
toa dxSin^e inco^iing image. AHhough not sho^n in FIGs. 2A and2B. H a modrfied gray-scale m«ge is to be produced. 

irJLoe fe S^hreshold«J ina "sinple- fashion using a fixed, p.e-def^ed threshold, having a value IT. as that value 
isdS ikw. The modHied gray-scale image can then be further processed. e.g.. through scaling or fiHering. as 

^^^^'Ifoartfeular upon starting method 200. step 203 is firsi periormed. Thfe step determines a gradient strengthtor 
Dixe r?D -nite is kocomplished by use of the so-called "Sober gradient operator on a v«ndow prxefe certered^ 
n 1 ■ AS shown in RG. 3A. this matrix, shown as matrix 300. is a 3-by-3 window centered about p.xel(i j). As collectively 
dSined in equations (1)-<3) below, the Sobel operator relies on computing horizontal and vertical pixel intensity gradients. 
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eX(i.D and GY(i,j). respectively, and lor each pixel position fij) torming the gradient strength. G(i j) as an absolute sum 
ol GX(ij) and GYfi j): 

GX(I j) - LfHl + 2L(i+1 j) + L(i+1 • Lfi-1 - 2Mi-l j) - Lfi-I (i) 
GY(ij)»L0-lj+1)4 2L(ijO) + Lfi+1j+1)-MI-1j-1)-2MU-1)-lX»+1j-1^ <2) 

G(ij)-|GX(ij)|4|GY(i.j)| ' (3). 

where: G(i.fl is the gradient strength at pixel position 

. (ij): and . ^ 

Lfij) is the image intensity, luminance, at pixel 

The reSg'gl'adient strength value for every image pixel collectively forms a gradient strength record for the entire 

^ OTOe'the^gradient strength. G(i.D. is determined lor pxelfij). method 200 advances to step 206. This step, when 
nerformed determines the area gradient tor pixel posHion (i j). i.e.. GS(i.j-). as the sum of the gradient strengths for each 
Ind every pixel position v^ithin an (N-2)-by-(N-2) windo.. centered about pixel position (i j). This Window is illustratively 
S to^ 5 Dixete in size and is shown, as window 370. in FIG. 3C for an N-by-N. aiustratively 7-by'7. v«ndow shm<m in FIG. 
3B the latter being window 330. centered about pixel{ij). For purposes of comparison, the periphery o* an N-l^N 
wiiUow is shown as window 350 in FIG. 3C. Though shown sequentially to simplify illustration, step 245 is generally 
Deriormed at essentially the same time, as symbolized by dashed Iine244. as fe steps 203 and 206, Step 244 determines 
Si Irf^Sium and maximum pixel intensity values. and L^. respectively, in an N^y-N window cerrtered about 

'"**o£U the area gradient is determined for pixel position (i j). then, through the remainder of me»wd 200. the three 
image measures. GSOj) and U*. and L„«,. associated with this particular pixel position are used to classify pixelfij) 
as an obiect Dixel i e black, or a background pixel. i.e.. white. 

In oarticular decfeion step 208 is performed to assess whether the value ol the area gradient for pfatel(ii), GSfi j>. . 
e^r^JTa ore-d'elined threshold value. GT or not. This test determines whether pixelfij) lies in a vidhlty of an edge n 
tKn^nned imaoe or not H the area gradient is less than the threshold value. GT. then pixel(i.i) does not lie near an 
llr^aHenTe oixelO D lies WitWn a localized relatively constant tone. I.e.. "Ilaf field, region ol the scanned giuy-feuile 
^oe Iniiis' rase method 200 advances along NO path 21 1 emanating from decision block 208 to decision block 215. 
This latter decision block determines whether the gray-scale intensity of pixel(i.D. i.e.. Lb. exceeds another pre^ieTned 
fhreehoM value IT M this grayscale value is less than the threshold, the pixel is classified as an dbject pixel, Le., here 
wl^-^henwise the pixel is classified as a background pixel. i.e.. here whHe. SpecHically. on the one hand, if pixel 
SL^ilN L. is lUs than or equal to threshold IT. decision Wo* 215 advances method 200. along NO path 217. to 
decision tiiock 222 This latter dedsion block determines wrhether a user has previously Instmcted the method to produce 
a hinarv or orav-scale output pixel. H a binary pixel is desired, then decfeion block 222 advances the method, via YES 
nath 22S lo bl«>ck228 which. in turn, sets an intensity of output pixel(i.i) to black, i.e.. rero. Alternatively, if a gray-scale 
^tout fe desired then decision block 222 advances method 200. via NO path 224. to blodt 230. Thte latter block, when 
oortofmed sets the intensity of output pixel(i j) to the intensity of L^. without any modHications made thereta If. on the 
Cttier ha«i pixel intensity, k. exceeds threshoW IT. decision btock 215 advances method 200. atong YES path 21B. to 
decteton block 232 TNs latter dedsion bloch deter mines whether a user has previously instructed the method to produce 
a binarv or oray-scale output pixel. If a binary pixel fe desired, then decision block 232 advances the method, via YES 
oath 235 to block 237 which, in turn, sets an intensity of output pixelfi.D to white, i.e.. one. Alternatively, if a gray-scale 
outout fe desired then decfeion blodt 232 advances method 200. via NO path 234. to Wodt 241. This latter btock. when 
r^ormed sets the intensity of output pixel(i j) to the intensity of L,. without any modif ications made therela Once step 
Sr237 w 241 fe performed, method 200 fe completed for pixelfij): the method fe then repeated for the next image 

"^^MematitSrH a^rS^adient GS(ij) exceeds the threshoW value. GT. then pixelfij) lies inthe vidnity of an edge. 
In thfe case step 245 is now performed to ascertain the values of L^, and L^. if these values have not already been 
deter mined* as set forth above. Thereafter, method 200 advances to block 248 which calculates an average pixel intensi^ 
value. U . occurring within the N-by-N pixel window centered about pixel posHion (i j). This average intensity value is 
simolv de^rmined by averaging the values L^, and L^in. 

Once thte average value has been ascertained, method 200 advances to decision block 251 which compares the 
intensity of pixel(i D. i-e-. U. against »s associated average intensity value. L„vg. When thte pixel fe situated on a darker 
side ol an edoe and hence an objed pixel, then its associated average intensity value vwll be greater than or equal to 
its intensity value U In this case, the output binary pixel tor pixel position (i j) will be set to black. Otherwise. If pfeelfi j) 
is situated near an edoe but its average intensity value. L^g, wouW be less than its intensHy value. 1^. then this pixel s 
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L „ then decision block 251 advances method 200. along '^^P^f^^'^^ a binary or gray-scale output pixel. « a 

drtlrmLs whether a user has previou^ fZ"^^ T^^^t^^l 2^. 
binary pixel is desired, then dec,>.on W^^^2^^^^^^ 

sets an intensity ot output P^f^'t'-O/^f/,^ 'i' J^^^ "°^^^0 m t^^blocKwhen periormed. determines whether 
advances rnethod 200. v.aW path 26^od^^^^ 

pixel intensity. U- ^^^^''^^'^'^'^^t^^llT^. ien executed, sets the gray-scate output tor 
Ft. then method 200 advarices. along '^^X^:'^^^^^^^^^^ the value ot threshold IT. then n^ethod 

value that is sHghtly less, i-^, -rt- _ 

A«erhative.y.i1gray-^^^^^^^ ^,,^„er deciston bloa^'determin^ whether 

251 advances '"ethod^^'^^^I'^iL^^^ io woduce a binary or gray-scale output pixel. H a binary pixel is desired, 
a user has previously nstructed ^"^^^"^^g ^ block 285 which, in turn, sets an Intensity of output 
then decision Woc^ 280 ad^~^e -^^^^^ advances method 200. 

pixel(ij) to whHe. ..e 'jj? ^^JScSC^en periormed. determines whether pixel intensity, is 'ess 
via NO path 284. lo dec« on b'ock290. "^^^ or is equal to threshold IT. then method 200 
than pre-defined tNeshoW ^be H^^" '""^^ lenSeliJS Sts the grayscale output lor pixelf. j) to the pixel 
advances, along NO path 292 to block 295. ^^^^^ then method 200 advances; alorHi YES path 

intensity value U- feS^ "^^S^Sl J^sSe iu^^^iSlJ) to a value that is slightly larger. ..e.. IT*. 

294. to block 297. v/h.ch. when executed^ me fi*^^'* ,^ respectively, threshold IT is not critical 

rir^SSa^y^eS^^^^l^i^^^^^ 

fhen'repeated for the ne^ ^^O* ^"^^r^;^*^^^ depicts intensity profile 400 of an illustratVe scan 

Wrth this understandirjg in '^^J*^^^^ ' 10 shown in Fia 1 . As a result of processing 

line of an original gray-scale "^06. su* ^ ^"^^ J.^^^ in FIC3. 5. results. As is readily apparent 

profile 400 through our «irver*ve J^f ^'f '"^!^^^ n«ge pixels located near an edge are modHied. 

Trom comparing profiles 400 ^^^.Tii^^ta a irk? si^^^^^^ eje a^^ while rts intensity is larger than threshold 

in thte regard, when such a pixe « J",^f^*^fl^?* Jj^^^^^ IT. Ahernatively. when an image 

value IT. the intensity of fh« p.xel « ^^^'^^^f^^^^^^^ IT; the intensity of thfe pixel is 

SiSTofjaC;?.^^^^^^^^^ 

iSed gray-scale image against fbced t^y«^^^,[^ . ..-.^ specHically drcurt 600. of our present invention. 
FIG-idepctsablockdiasrarnotaprefe^^^ V . ^ ^ 

AS shown, clicuit 600 6 formed of line ^^^f V^^l^i 625 650 and 655; 7-by-7 Max and Min detector 635; 
gradient de.ec.or 615; sum of gradients -^^Jf^^"^'!^^^^^ 664. and gates 662. 670 and 

averaging circuit 640; multp exors 680 ^'^f^^^'^S/j'-^^rn^ 2B and discussed in detail above. 

675. Circuit 600 collectively implements method 200 ^,^P'!'!f j;^^^^ ^.a .eeds 605 and 608. to an input of 
in operation. eigh.*« input ^^f^P^^^^^^^^ specif ica.y series^nneCed single 

line delays 610 and to an nput of 7^by-7 Maxand "^^"^^^ image pixel data centered around image pixelf.j). 
line delay elements 610,. 610^ and eiOs. P«^" ® ^ ® "^^T^^ Jne of the window. Tlie outputs of all three 

Each delay element is tapped at ^^^J^^^^^^^ through calculation ol the Sobel 

delay ^'en^^r^s a.e rcutedto r^e^^^^ ^^S^XradieS >^;Ce for pixeKiJ). i.e.. G(ij). on output leads 617. This 
operator, as d«f;^J^^,^^ .^^u^^ of gradiLs circuit 620 which, in turn, sums all the gradient intensrty values 
gradient value is appiied lo an inpu^ lo y nrovides the resuHant sum, as an area gradient value, i.e. 

?n a 5^-5 window cen.e^ agut P^e -^^^^^-^F^f ^^^^ in detail belo.. This area gracTier* value 

6S(ij). on 12*« '^^.^.^'^^SL^rS^r 6^^^^^^ this value against pre<fefined gradient threshold. GT: 

is applied to an input ( A*) 'T'^'^^^^ The resulting comparison output, appearing on 

the latter being applied to another '^^.^ ^7J°.*''J^^2rtW^^^ or not The comparison output is applied as an 
•I'SIS aXo ru!f i:%T4;S T^uS^ as diseased in detaH below, the appropriate 

Sy-s^e « one Of the predef ined values IT- or IT*. 
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Max and Miri detector 635. depicted In FIG. 8 and discussed In detail below, ascertains the maximum and nwiimum 
pixel intensny values, i.e. L„», and L^. of those pixels contained wHhin a 7^-7 window centered^.Jpixdf..» 
Rp^ .Nino L_ and U, values, appearing on leads 637 and 639. are then averaged by averaging circuit 640. This circut 
Mntairs su?)?mer 642""which merely adds these two values together inlo a resultant sum. and /2 and delay circuit 646 
wJiich Urolements a divide by two operation by shitting the sum one-bit to the right; hence dropping the least signif icart 
bit TheTesuItant averaged intensHy value is then appropriately delayed Within circinl 646 tor purposes d achie^ng 
proper synchronization within drcult 600. ^. . . 

H the area gradient value. GS(i j). exceeds the pre-defined gradient threshold. GT. then the averaged intensrty value. 
L used as a threshold level in determining the value of output center pbtelfi j): else. H the area gradient value is less 
ttan or eoual to the gradient threshold, then value IT Is used as the threshold level in determining the value d output 
center oixeKi 1) In this regard, the averaged intensity value. is applied to one inpul of comparator 650. The cunent 
center Dixel\«lue U is applied through delay element 630 to another input of comparator 650 as well as to one input 
Qt con»arator 655 The delay of element 630 Is set to assure that the proper corresponding values of and 1^ are 
.jvnrh^nouslv aDoHed to collectively comparators 650 and 656. multiplexors 680 and 690, and gating circuit 660. The 
fbiedthreshold value. IT. Is applied to another Input of comparator 655. Comparator 650 produces a low or high or low 
level outDut on lead 653 H pixel intensity value Lc fe less than, or equal to or greater than, respectively, its associated 
aTeraoed intensHy value. Uvfl- This output level is appDed to both one input m of multiplexor 680 and one input of 
AND Lie 662 Multiplexor 680 selects the output binary pixel as between tv«> bHs generated from using two different 
thiestoKte i e * value IT or Lavg- 'n that regard, comparator 655 produces a high output level at Its A>B output whenever 
thP rwedefined threshold value IT is greater than pixel intensHy value l^. The level at output A>B is routed, via leads 
BCT toanother irpul (-O") of multiplexor 680 and to one input of AND gate 570. F^ultiplexor 680 produces the output 
Kina'rv x/alue lor oixelO D. To do so. the comparison output level produced by comparator 625. indicative of whether tiie 
a^ Ladient GSQ fl exceeds the gradient ttireshokJ. GT. Is appied as a select signal, via lead 628. 10 a select fS^ 
\n»A of multiplexor 680 H this select signal is high, thereby indicafing that the area gradient exceedsthe gradierrt thresh- 
oU then muHiplexor 680 routes the level applied to Hs 'I* input, i.e., that generated by comparator 650. to binary output 
lead 33- else the multiplexor routes the level then appearing at Hs-O" input to lead 33. 

MuttiDlexor 690 routes the center pixel value. U or a pre-defined value fT* or IT- as the output grayscale value Id 
eiQht*h output leads 37. Pre-defined values IT* and IT along with center pixel value Uc are applied to diflerenl conre- 
»v>nrfinfl eioht-bit inputs to multiplexor 690. The output of this multiplexor is determined by the state of Um select signals. 
STa^Tsv H tfiese signals assume the binary values sero. 'V or S'. then the multiplexor will route center pixel value 
I value IT* or value fT-. respectively, to output leads 37. Gating circuit 660. in response to the comparison output 
stonate Droduced by comparators 625. 650 and 655 generates, by simple combinatorial logic, the two select signals. SO 
a^Si aoDlied to multiplexor 690. SpecHcaDy. H the area gradient is not larger than the gradient threshold, then, as 
H^i«s'ed aljove oray-scale pixel value Uc. virhhout any modification, v>rill be appBed through multiplexor 690, to output 
lids37 AHerna't^ely. H the area gradient exceeds the gradient threshold, then multiplexor 690 vwll apply either value 
IT* or rr" as a modHied grayscale output value to lead 37 based upon whether center pixel intensrty value 1, is less 
hlnH.- rorresDondina average pixel intensHy value. L^. or not. Since the operation of gating circuit 660 is seH-evWent 
trmi the abov^ descr^jtion to anyone skilled in the art, it will not be discussed m any further detail. Values IT- and IT* 
are mereh^ held in appropriate registers (not shown) and trom there applied to corresponding inputs of multiplexor 690. 

FIG 7 depicts a block diagram of Sum of Gradients CircuH 620 which forms pari of circuit 600 shown in FIG. 6. 
rircuH620 as shovm In FIG. 7, Is formed of adder 710 and line delays 720, the latter containing four series-connected 
sir^ol^line delay elements 720o. 720,. 7202 and 7203. IrKoming gradient intensity values are applied, over lead 617 
from Gradient detection ciicuH 615 (shown in FIG. 6), to one input ol adder 710. shown m FIG. 7. In addHion. tiie output 
of each of the four line delays 720 is routed over a dlHerent one of tour leedback leads 715 to a different corresponding 
input of this adder. As a result adder 710 forms partial sums of 1-by-5 gradient values wfhich are applied, as input, to 
d^av element 720o. To generate a 5-by-5 sum of the intensity gradients, hence producing an area gradient measure. 
feurDrecedinQ corresponding 1 -by-5 sums are added together within adder 7i 0 to a present 1 -by-5 sum, v«tti the resuH- 
ant werall 5-by-5 sum being applied to output lead 622. Use of these delay elements connected iri tills fasNon substan- 
tially reduces the amount of logic that would othenvise be needed to generate twenty-five intermediate sums. 

FIG 8 depicts a tilock diagram ot 7-t3y-7 Maximum and Minimum Detector 635 wKch also forms part of drcuH 600 
shovwi in FIG 6. As noted above, detector 635 determines the maximum and minimum pixel intensity values, L^, and 
L_ resoectively withm a 7-t)y-7 window centered about pixel posHion0.j). This detector is formed of two separate 
ciJTiiits^ximum detecting circuit 805 and minimum detecting circuit 840 which extract a pixel value having a maximum 
and minimum intensity value, respectively, of all the pixels contained wHhin ttie 7-by7 window centered around pixel(l j) 
ar^ r*«»,ectively aoply tiiose two values to leads 637 and 639. Circuit 805 contains maximum detector 810 and line 
detevs^O the latt^^eing formed of six series-connecled single-line delay elements 820o. 820,, 82O2, 82O3. 82O4 and 
820 Similarly circuit 840 contains minimum detector 850 and line delays 860, ttie latter being formed of six series-, 
connected sinole-line delay elements 86O0. 860,. 86O2, 86O3, 86O4 and BSOs- Inasmuch as circuits 805 and 840 function 
is an identical manner wHh the exception that detector 810 locales maximum values while detector 850 locates a minimum 
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. c« hnihUcHn the same series of pbcel intensity values applied over lead 608. we v«^^ 

L^^^aT^^en reacffly appreciate how circuH 840 functions Irom this d.scuss«n. 
?4o!Sa oLi tlnsi^ Values a e^lied. over lead 608 to one input o. -maximum detector 810. In addHton the 
J^^^IS, r^e J" delays 820 Isrouled over a diflerent one d six feedback leads to a respertn,e input of 
output of each of the 6« "^^^ 8 ^ 0 ^ ma^nium pixel intensity value from a 1 -by-7 series of p«e! 

'?^a.2°rSs Ste mS™m V uTas input to fine delay element 820s. In cor^inCion with sfac Fece^ng corr^ 

re:^!:;re^2de:;™^^ 

. c^iS^toMh^ShOldS^^^^ 

by the vaues defined for tl^^sholdse^^ 

Of edges in an image. A relat«/ely low ^lal- fields m that regard, a low IT value tends to dasally 

Classify piiels located '--^e reg.^^^^^ 

pixels Of a unHor m 9fByj^^^^^^, SfS^ ISi^ a ftei^ threshold IT. In this situation, the value of threshold GT 
purposes performs s.m-ar to ^^1^^^^°^^^^ our Invention to classify pixels 1^ essenllaDy solely cort^ 
v.ill always be '«'9«^»'lf eo J^^^ix^Tes" Id IT Our invention can also produce an outline image through 

othe^J^S e^oSmel that incoiporate the teachings of the inventton may easily constructed by those sWIIed « 
the art 

■Kin ^iRTRIAI AP °' irARILITV AND ADVANTAGES 

Tw snvention IS useful in image scanning systems and particularly for thresholding scanned gray^e 

• '^riTrJiTne ^ T^e'nv^^^^ povkJes more accurate threshotding than that pre^ioo^ 

StTi iraX immi.«y t/bacKground noise in the scanned image and substanfa-y 

eliminating boundary artHacts from a threshokJed inage. 

Claims 

. A „,.,hnri lor thresholding an irput gray-scale image into a first output image, wherein said input image is formed 

1 . A method '°^<^^r;°'°^?Ja ^JJ^^^^^ value assodated therewith, and wherein said first output image 
tSZt^^s^^^Zl^^^ ou^xn P«el value associated therewith, characterized in that the 

cunent?lel^«S;n (i j^rthe input image, a maximum pixel value and a minimum p«el value of the pixel values 

riSSn'^'t" S^^rlh^'^S'^g^^^^^ value and the maximum and mirtimum pixel values, a currer^e of 
xel Su^ pxel ^Hion (ij) in the input image into an output pixel value at a corresponding 

position in the first output image, 
o ThP method of claim 1 wherein the area gradiert ascertaining step comprises the steps of: _ 

2. The '^'^J.^'^ JO a third window (370). of the pixel values, of a pre-defined size and centered aboj 
^ Sll^^Si j) in the input image, an intenshy gradient. G(i j). value for the current pixel posrtwn sudi 

a s':SeSr^ i^^^^^^^^^^ the input image, a plurality of corresponding intensity gradient values « 

**^'"1or,I?ng the first window of intensity gradient values from the plurality of intensity gradient values and. in 
response to said first window, deterrwr^ng said area gradient value 

, Th. method in claim 2 wherein said first window forming and area gradient determining step comprises the step of 
^^!::^2Z7Ls of the intensity gradient values in said f irst window to produce the area gradient value. 
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The method in claim 3 wherein said threshdding step conprises the steps 

comDaring the area gradient value. GS(ij). to a pre-defned gradient threshold value. GT. so as to Prodooe 
a corrparison signal indicative of whether a current one input pixel located at the current pixel position fij) m the 
infMit imanp liPs In 8 vicinitv of an edge in said input image; 

T th^ <^)nparison signal indicates that said current one input pixel does not 6e in the vicinity c1 the edge. 
threshokjiOQ in response to said comparison signal, said input pixel value at position p j) in the input irnage against 
a pr^S^i^Sj t"x«3s^ay-scale threshold value. IT. to yield a coriesponding binary output value at pure! posrt«n (I j) 

^ *!11heSS*on sjnal indicates that said one current input pixel does lie within the vicinity ol an edge, 
settina in response to said conpaiison signal, said corresponding binary output value to a first or.second state H 
tte cSient onTpixel value eHher exceeds or is less than an average ol the maximum and minimum pixel values, 
respectively. 

The method in claims 3 or 4 wherein said intensity gradient measuring step comprises the step ol producing the 
intensity gradient value lor the current pixel position by processing said third window of in^ pbcel values through 
a Sobel operator. 

The method in claim 5 wherein the third window is a 3-by-3 window ol input pixel values and the Sobel operator 
implements the following equations: 

GXfi j) - Lfi+I + 2L(i4l j) + LO+I • J-1) • 2UI-1 j) • I^M 

GY(ij) « LO-I + 2Mij+1) + Mi+1 j+1) • Lfi-I - 2Mij-1) - l^i+1J-1): 



and 



GpJ).|GX{ij)|+|GY(IJ)| 



where: L(i j) is an input pixel value, in luminance, for 
pixel posHion (I j) in the input image. 

T The method in claim 4 furttier comprising the steps of: 

7. ne ^"^^ response to said conparison signal and the pixel value (Lc) at the current pixel position fij). a 
mod»i5 oray-sc^le output pixel value at position (i j) in a second output image, wherein. H the comparison scnal 
JSkatVs tt>at the one cunert iipul pixel does not lie in the vicinity of the edge In said input image, the modHied 
orav-scale oulDul pixel value is set equal to the pixel value Lc. or H the comparison signal Indicates that the cuirenl 
one inout oixel does lie in the vicinity of the edge, the modHied gray-scale output pixel value is set equal to a pre- 
definedvalue greater than or less than the threshold value IT vJhen the pixel value Lq is greater or less than, respec- 

tivelv the threshold value IT: and „ . 

thresholding the modHied gray-scale output pixel value, against the threshold value IT. to yield a conesponding 
second binary output pixel value at a pixel posHion (i.J) within a second output image. 

8 ADoaratus lor thiesholding an input gray-scale image into a first output image, wherein said input image is formed 
ofSu pixete each having a multi-bit gray-scale pixel value associated therewith, and wherein said first output image 
is formed of pixels each having a corresponding output pixel value associated therewith, characterized in that the 
apparatus utilizes the steps recHed in any of claims 1-7. 
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